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(54) DEVICE AND METHOD FOR CONVERTING SIGN LANGUAGE 

(57)Abstract: 

PURPOSE: To generate a natural language expression by not 
only recognizing a word but also estimating and replenishing 
speech omitted between words, at the time of recognizing sign 
language. 

CONSTITUTION: The device is provided with an input means 
105 for inputting at least motion of hands, a language 
generating means (102) for recognizing the corresponding word 
from the inputted motion of hands, and generating a natural 
language expression from a relation between the recognized 
words, and an output means (103) for outputting the generated 
natural language expression. According to this constitution, the 
expression of sign language can be converted into an ordinary 
language expression, therefore, it becomes easily 
understandable. 
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t. 

±ieA^Lfc^(Di!i#d:y, *tis-r-smi§£i2i£u ± 

Hi** 2] ±EWI§±fiS^f2:l*. ±EA7JLfc^a>B) 

#<Di!l#£A7J-f €>A2>£B£JBL*$C££$#«i:-r3 
Ht*4f 1 l=Etta>¥B£&SB. 

y**. k^<o<4b. fc<fcuw¥-o>ip]#£msursiic^ 
<t 3 i=k«<d¥B£££b. 

CIS*«6] -tE*HB»*«fcL-CDPT?*>y* 
SsSffll** C t £ f £Ht#]® 2 l-EiE0>^fiS£& 

tii*ii7] ±.f&mtmm%-&£Lx-n.-=?)\,*v h 

tm**c£*1«S£ + 4B*«2l=Ea©¥BB»a 
Eo 

[MB* 8] JiEBIf SB¥»-CBKtaBft< 1 Olcj** 
&ftl*«*(4. «S!<D<Sffi$^ySI+^«r^e^3ISC 
<t £^®<t-r -5 If #JI2 ICEKO)^ B£&£fi. 

[18**9] ±E^ysi+«?w^fs-ei*, &w§i--5£ 

« t * c t £ 4$®t t -r i> titum 2 i-Ei&a>¥B££g 
a. 

[Wjrbi o] ±E*B§ffl3t^si*. ±EJHteeitt^a 

1= «fc y <t . ±E<S y Slf fi?#r¥-fS:fr t> ;*£ -5 £ 
5 C £ t -T *»#m 2 KEKO^SggSlg 

So 

EBfcBi 1] ±E*B§i§<Dffi3fcl4. miiHOSttW* 

a» 

[|g#«i 2] ±EaS7J^f8:l4, ±fiE^*vfcg^^SIS 
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nmmi 4] 4>*K<tt,¥-0>ib££A7j-f-i>3Ma<!:. 
t. 

EBB $ 4xfcmi§T'OT(l y g Iffgflr £ *■ * t . 
±E»»S. -£OT&ttfcfcTI4£&tt3tj££^TiirB§ 

•5 Sffl^ £ ffl l^T ^iS<D^<DiS # V li«S§ 3? *tT I* -5* 

£<fcy*h*:-f s^fisBtsiu ±eteMiL^JMima>H 
&*bbb£ aa^-r -a c t £*#g*i: -r -s^isgBSTj&o 

[IS#il1 6] -hEI2iac75S3^^t»i2i^^*i.fc*iiF B la) 

&iv ^mj:mEmm^±fS.-r^zt^<imt^-i>m^. 

m 1 5 lcEK<7>^iS^^7fa„ 

33 <fc i/%mmomm £trfc 5 w t ic <t y a asfcrnsasi 

^t-r^iB^in 7 lcE®<0¥IS^7f;S „ 
Ls JiE^<Dlb#A<a^§«^^:$ir<^^H'|C3t 
[IS#iS2 0] ^CDii#^A73U. 

±e a ± l is # zmm t: mm l . 

r±E*isrosi5lfc<*t/mi*^#r. -hEmi§<7> 0 ° B I^*J 

r ^isco^cois # r* i**bs $ tvc t> s mm $ *•% l . 
s muss ^ ^fiic-r & c t <t ? * ¥ts^^7j 

[000 1] 

[0002] 



$—X a>t°i-f<>y vXfAX >— 

•X~/^-T-<91 (1991« I237l^bl2 
4 21 (Proceedings of Confer 
ence on Human Factors inC 
omputing Systems CHI ' 91 
(1991), p P 2 3 7-24 2) ) ICfcL^^b 

tiTi^-Sct^ic. f#»&-fe>-y— (Dot^fc^iaicj: y* 
t > t a#o>/ - > t ■ § c t ic * y * mm l 

[0 0 0 3] L-c 14. *»BB¥1 -1 4 

4 6 7 5^«lciSttStirt^J:5l=:. fe#lf**tf= 

6. 

[0 0 0 4] 

ffifc>*tn*&<Di4. r*Bl!*Bj tzi£tm£*i&t,<D 

*(D*S3&*ig (SitB£*i*3) a>*£^K-e*si 
u rr. I4j ©ck^ttJBB^ rn^. s>*i 

co. co j a><fcdWB**Btt£l4B**B-r*. 

^B-caa*4x4*Bco+"C i b»H-v5>«i»H. jmmhu 

»»»Hfti:a)SfflBI*fi**fc«:^l*ii«*B-r*fc 
BB*^fc*B*ottt^£/£it©in#a)«*afB 
T»l4e«a*B«W=<f6ai^i:l^PJBA<*ofc. 

[0 0 0 5] *fc % &#<D&3feftffi-Cl4. »X**B» 
©»fttLTt^6 0 »3t*l4 Tfcj Tim r^j fcf- 
X*^8btt0)fc5o »X*l4*B0>mB^S*tfc 
y. BB-C^ttt^SlcWJBiWfttflDtLrH^Stia) 

r% ^BA*cD^^?*B■r*c^:r4l$t^i:ftl^„ #o 

±t<dbb*ix*biz»x*wb»«u *<d 
»**t*a)»aEB«LTj:»*tt*+*ak#cD«*a 

[0006] *^cDgifti4. #Bl=J3i^rBB*ttfc 
JMH*&. X»tLrp«Kac*B«ait±*r*cfcic 

[0 0 0 7] 

*MO¥Ba**«fc<fct/^I4. ->IcD#<D1!j^£I2 
»Lr»«?-r**BlcK*L. BBttS^&JUBmoB 

y*itB«£B*u ^Bsa*^— ^^ffl^rflsy »it 

nnntt^asfflBaBffieftitsi*. sjR&iiisa 
£±/rr & cfc 5 ufc tcD-e&^o 
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[0008] o*y, aysitnaar=»«*Bn-T?«K 
*ttr^*4&a!j^$ft«5fc«)(z, « yai+iifiRiZcfe^r 
s^ftttttB^aiJUBicaa^dicLfcta)-!?**. 

[0009] RygitBgflgizfc-smi§raT*«B§* 

ftTt**B«ft£(DSfflS«dfctf>l^ £S6»lziELl* 
cfc^lc. Ufl* KVB. fi$8BR* MBRttJfaHSAIB 
(DiSm $ £<b * tMCtt 5 £ ^ ic Lfc t CDT? . 
[0010] *fc % By>ltHBI^ft«JUnillt?*B» 
*iTl**»BR* ttfl* Ktf«H« ««Wttif*»5fc 
£>lc. ft y »itl«<D*i*M*fcl4ftBB»l806* «-r«i» 

[0 0 1 1 ] 

[ftffl] ±BB«*B*BL**cfcfz i fcy. Bxli. 

r&j r^j rib&aij r^< j rjg^j <ti^-il(D 
*BW*^B-eBBLfc4:aN *r, «y«it«Wri=* 
y rfAj r#j r*»ilj tf-ttt-pfL rff<j 
Hl^««**6. WJfflL B»«»t?*y. *fc, rfr<j 
(4 rsoj <d@m»t*&4c & 0 ays 
i+raa>*Bg*gft;u-;nccfcy. r&j r^j rdb»51j 
(Dfciric. -tti^ti ri4j r^j ricj (DtettRtftSfr 
*u Sfc. rjB5j ti^5»H(DiKrrztt«]H r^j cd^ 
mstftiibtu r^<j £ rtJBdj cDPaicjg^^*-r«j 
MB r^j a>*ii»j&<tt;b*u *fc r^T< j t r^j <t 

r t JB o J (DM A<*ttttlzjE L < *«-T 4 cfc 5 lw^ffl|§ 
[0 0 1 2] 

[-Xttfl] isATx *BW(D*B«$iai^e>Hl 4$ffl 
l^tRWti. Hi 14. *flM<D-||JfiffiJ^^vXT- 
AfS^sr*. c p u i o 2 t A±i^M K 1 o 

1. atffgf-*AA8il0 5) <t£li^^M (CR 

tio3) &*%y i 0 4&e*fett*«±-ena£ 

tt. 2(4^ISr— £A2)3£g 1 0 5 36^A**tt4EBI 
\J)"r—$ 7^»b. S«!J3S:*B*S-eft44fiEXl 4$ 
iUti^P^A, 3I4BMXA7— f > 7 3^&JHBB 
£t£f&-r£^ny^A. 4tt«Bno)«yBltHffftM 
ffti^P^A, 6(4BUBltHBCcft«J|LBn-e* 

^A. 8l4^ayvA2<DfflB-C«t>ti*»«f-f— ^ 
;u. 1 0i4«y»(tB»4-cttt3tt*»*rx$ 9 
l4^|gT^^^tL^wm<Dp D pBi:SR*^fejir1 -T^miSS* 
1 1 f4*B-CB^6ti6»B«:ifB*l=«*»a>a 

BSB3E-r**»». i 2i4«yaitBa«icfc**BM 
■e*B**i-ct^«»Bt*wt-r«*at**«*B*i* 

i 3r4Sfflf *JHBa>SB*at«3E-r*{5ffl 
[0 0 13] B7I4BBA*-?— *7<DBBftT— *B 



(3) 



(4) 



ftmW- 5 - 2 5 O 4 O 7 



V*>^S|£ffll*T\ #<D»#£A*LT4,«fcl\, 7 
3. 7 4. RXfl 5f*g-^-*>:?'J >^B$£ljTO. T1 
n \ZtSliZ>&^—$ 7 1 t£ff- * 7 2 <£>f& 

tt»Bf $*^o 7 1 1 1 fgcom i Mffittfttt 

7 1 2(*6^<Dff1ffia>»2HfB0)ftS 

^itf-^, 7 1 SJi^OxJSS^eM^a-T^r- 

£.7 1 4l*^(Dy&*S<Dft®£a^— 7 1 5 
li£f^Oz&*|[(7){iM£Sf ^— 7 16l^^(DfS] 

£<d x$&t(Dnm&mTtT— 7 1 7iia^cDyi6<t 

COEg^-r-x— 7 1 8 1*^^(0 zt6<tCDftJg^« 
[0 0 14] 0 8 1*^18^— * A 0 5^bA^] 

is 8 1 . mmo>&m8 2. miKDSifcs 3. mmo&v 

5fc8 4. «y3fe<t:(Dll8«8 5, mi§Offi^S8 6^t> 

^^^ttTl^o 01 01*. 8?#rX£ ^ 1 0<DtHig£ 
S^HT^ «y«lt»«f4(D»«tf*tSl 00 la^m 

si oo4t^* '^cajtifcaTs^ 01 

[00 15]B12lt *B§*f ft;u-;u 1 2(0*»Mft 
eUS^-Tlir*. ^u— 1 2 1 l*l£tti 2 2 1 £ftfM 

2 2 2 1 2 2 3*<l^»fC|ifcy£o£lN5ftfM 2 

2 a<s5*= stifc <h y 7ccD*Bizifi-r-<#ajt^at 1 

2 3JILt^|, 0 ;u— ;H*J1 2 4t,^»C, ftf*l 2 

5 1 Ax&ftfti 2 5 4T^£*L63:#1 2 StfmzZtl 

tt^^o #i*J*\ ;u— ;H«1 2 1 I*. f$y 7cco*l§(7)Q a n 
isa>«H#MH-e* ^0. «yaitiia«3b<±». b*m 
y «i+m«o)*7r»«in*ffl3t-r * c <t s a it 1^4. 

[0016] 01311 1 3 <0Af*0fl£«"ria 

*o IU1 41*. ffl3t*tifcttHI^**ti«4fiR*1 4<D 
[0 0 17] &|C0 2. 0 3. 04. 05. 0 6£flH> 



•y^3(DBflBlcol^r(*. 0 3^fflt>TMl3i¥L<lttB^ 

xf^4tit WH9ja)j|iHlHa)fl(ysitHflk 

8(C^itt"^)o X^^^4C7)l¥Sffi[Z-Ql>T(*. 04. 0 

5*ffli^rMicBL<lttw<-*. x^^e-ei*. <*y 

a^u— ^ui 2. fejitfgfflai 3^ffli^r. jmumt? 

S«SttSIS««*^fitL. ±fiE*1 4i:LTMt^o 

[0018] B3a4iiieKasa>Asa)««£^rBB 
-r-^ (tn^tm ^bhiaat*--* 7 

JtttL. «»c*HM*BIIILaA<6«yttr*0>-Cfc 
So ::-c-a~7^'> ha>*SMft*B* BIB^cd 
(Efflicoi^ri*-r-cica<ttc>tirt^iiyt5fc*. « 

*l*. ^J1-#S. r-a-7^3>ea-$ flffli:** 
SI^S^J (m^a«**U3IK©. 1 98 8« p 9 3 
- P 1 2 8lCiz!i-<f>HTl^ 0 

[0 0 19] 1 -CI*. ^^^^-^7^^ 

wym-r^r— *a>«B (j»k % wy as utsra tnf.ro <d 

^fc. mi§*I^P 2liT0+W2lC-tr^ h-r^o £ 

cr% w2(*wyttLBWia)«*fiI**-r. *tvz?3 
2-ei*. BfgA*!^— ^ 7An?>. ftsihfcwyiaig 

■©f-JtHHIBU f->t*6^C»«Lfc- 
a-7;i/*vHwA*l, LTSI^*1§Y (P 

1, P2) tdi^CD^^^Z (PI. P2) £#£o A 

l=ftft6*iftL^4:*l*tt*0!>|i«*a*-r*CttTf# 
*«^*fcl*. Si|(OBfflSJB«SWfflL/=y, fc*;*^btt 

fc«*, «*tf*i=«aiLfc*s«jfe-r*ftific*y 1 
oizst^rt <fct^. x^^^3 3-ei*. wyttsLEfflcD 

ft/Hfiwi *m?Ltzhm^. SS^riNftiMi^ici*. x 
f '^3 2CMot, 1 o/h$ftWymLBP B TCB»* 
K^*o Xf 7^3 5T*lt W1 ^&W2O>40y ULE 
F B 1<D*-C. *ioi:tBK«»^jELt^ait54x*ta>* 



f^3 7t^ fflyULBIHA*. ISISA^i^ — £ 7 0) 
[0 0 2 0] *fc % «HBKa93 0!)tta)Xtt^ft^L 

[0021] fcc*t?*Bw*. Bi=*r<*A*»* 

r*<Di§BT£#Br6Zi:lc < fcytt«ra£ LTffll**^. 
t^5^t\ztj:% 0 ^ 3 <DB»"C? 

«*Ba>««*iKra>Ba)4»-e«»LTteitii. 
6. 

[0 0 2 2] I4lt flRy»lt»«r40)rtS^*-r o & 

^4 1 T*fi. «tff-?Ji8 0)#H8 1 OftHfr 

K*B»»9£B*U -^^milOa a Dl^9 2ifl!* 
9 3ft»yBLT. Mtt^-^;U8C0 q D pp8 2 <tSR*8 

3ic#*»«-r£ 0 x-x^^4 2-eii, s-jmkob y ft 

£»*tU KW^r— ^U8<D«yft8 4 tBi«8 5IC-fe 

BKBl^ttBirr*. 
[00 2 3] B5I3\ Xf7?4 2(DSMi£*-rglT*a& 

fi6y5fe<B*fa>isaicoL^rittM-r*. x$i 
*-r«*iisa)mici*«yait»aA<fcy. -x-«<db 
■fc yatoci4<tt6*ir^*. -x 

i\ *tzn3zm<Dfamt\t* «ysitM«£*-r«(*s 

I*. -4xfc>CDlBJi£ffll^T* WB9J0>«BM(7)ffiyslt 

■Btiwr*. 

[0 0 2 4] Xf^?5 1 -CI*. Bffx— ?Jb8<DJMB 

8 i *5tsB^t>wicKyai-r. xf'^52m 
&i>*§^i*. sai^Tt*. xf7^5 3t'it ny 
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^-fo xf'^5 4tii »ytB**tfc*Bo)aw*B 

4«Wr^>7*Ort«i*Lt, »^a^* 0 Hi 0 

in iz^T&5teft&tfmt>tiz>o m 1 o(ds?w 
^*^^a>rtetB*r*ctrc ( fcy % -sz-i&omm 

<J r^j |*b»M«. r**aj f4»Br*tf* 

*il*3*tteA<»&*i«. tt±CD|IBtB*r^— ^yn 
0<D^y5fe8 4, WHf|8 5[Hz7ht5c 
[0 0 2 5] C(D®lTM±ffl©<Z)tt7U— A*£lf£ffH*£ 

rsggtj ic^uri* r^c^gj r±rc*-ej «cifa>«fc 

y. d(D*Ba)^iy— ASfflt\r*BHa)«yai+Ba« 
£«#rr£c<ht-e#£o «y 

"Cfc^>%COCD4 l tr^^5i^f> Lt^O^SArffy > ttR 

^5 6T*i4. aycitBBa)»a;a>^tvfcx>hu— c 

1 oic-bv hU ay<0WBMa>ftyfttf«r£tft 

[0026] lU±0OKB3^&B&^«:J:?lz« &<DJMi 
rg5j Wx^'v^? 1 oicB«ti«&. rs«5j fc 

mxzvtrotomkm'&itix* r^<j a< rg 
o j ©Bttft-cfcizt^y, fi?«T^-^;u8ic^ 

fliyaitBfll3b<3ESLftl^c& T-fc-So 

[0027] H6i*. ^m^ecDmm^m^mx^ 

«y»(t»«r4 0)«*»6*Lfc. ffiySl+BflUcfc 

yur. 

[0 0 2 8] Xfv762m *B^-tO)*B<3!>«y 

ffir- ^U8(DfflftjSS8 6frtt$ftf^o Xfy?6 3 
Vlt. Tt^XCDMtiTT— ^U8a)^B!c-^L^rSQSLfc 

frif3^«3EL, »y*<fc*»*i*, x^^encM 
orgsys-To 

[0029] «±<DfflBo>**t % JI(«fl-eKB-r«. 
^«T^-^;u8(D5feli<D^i§ rfAj *<»yai*i, ^co 

BSIS3t^-;n 2fcB*S*ifclML ^— ;u«i 2 1*< 



(5) 



(6) 



t$P*8¥5-2 5 04 0 7 



M^6o Lfc^pt, 2 3&n'i=r£HX. 

frJWo 1 2 6-Cfi. Tfr<J <t r <»r j (DPfl 

1*5 J (D*!ji:»SI*;Sfl!« 1 3fr£> I"? j 13 2T?fe^C 
So Lfc^ot, 2 6£3mLfc*S 

* t'U^otl £«ty. »«TT— ^U8 0>«fteift8 6 

**f*. miss 1 **o)**tt3ttt*8 6ic»»r*. 

[0030] x^*v^6 4-ei4^tt^-^;u8 0li5ttS 
*8 6$a«-r*c:ticcfcy. u ±& 

Xl4|C«»-r4 0 CCDcfcdlCLT. ^fig^^frg^II 



*f*CRT 1 03±(rS^I§^fi£^:i 07ilt^*tL 
*o &tz. CRT 1 0 3±|C|*, miSW8 1t. ^ISA 

[003 1] 

[01] *^^<D-SUfi«0)->X^A«R6g|T*feSo 
[82] i»0)«i7P- **-TE|-Cfc4o 

[^3] mutKmtBM(o»mit»-ta^Ai. 
[|4] ^sitto^s^-rgi^fe^o 
[05] ffy*«Ura)tra«aicrB a eft«. 
[0 6] %m&ft&m<DUM£7Kirmvit>z> 0 

[07] SKA*)^-*©^— *«Jt*3F-rH-C**. 

[0 8] »#rr— -?)\,<Dt— -$»«iS^^-r0T*&^o 

[0 9] *li»S(7>fl:<*^J^^-r0T*&^o 

[01 O] »*fX5r ^/^O)^— *«3t*^0-ea&4. 

[011] tt»«a>*1*W*»1-B|-cfc6. 

[0 1 2] «BSt«^;u— ;ucr>Mi*^l^^-r0T?fe^o 

[013] 0T*&& O 

[01 4] *fefie*<D*(*«*^-rHT?fc*« 

[fftORffi 

3 -*ISB»0)«131^P ^ A. 4 -« y gitj&wcoaa 



[04] 

((214) 



41 



42 



h (15) 
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(ia 10) 



_LL 



mm 

(HI 1 1 ) 
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1 o] 
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